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I. INTRODUCTION 


This “CER MODEL PLANNING REPORT,” CDRL Item No. A006, contains the results 
of the "Cost Estimation Study,” contract NO0014~-85-C-0892, conducted for the 
Naval Center for Cost Analysis (under the auspices of the Office of Naval 
Research) during the period of performance 12 January 1987 through 04 April 
1987. The effort described in this report focuses upon the following three 
areas addressed in Task III:* (The statement and objectives of TASK III are 


given in Figure 1.-1, while. the schedule is shown in Figure 1.-2).) 


a 


(1) The collection of current AVIONICS data and subsequent derivation of 
preliminary CER (Cost Estimating Relationship) prototypes for ultimately 
calibrating the SASET model parameters. This includes the pa of 


SASET productivity factors and complexity multipliers; and 


(2) The categorization and organization of functional sizing data for 
formulating a suitable AVIONICS data base. This AVIONICS data base will 
be utilized in the SASET model in senerarins cost and schedule outputs; and 


(3) The calibration of the SASET model AVIONICS data base to ensure 
verification and validation of all SASET model parameters. In this 
respect, a total review of all SASET model requirements has begun. The 
intent is to update the “SASET REQUIREMENTS” document within the next 
quarterly reporting period. 


In addition, substantive effort is currently being devoted to the computeri- 
zation of the SASET model on an IBM PC. In this respect, most of the input 
screens have already been constructed, the data base for Ground Support 
software has been implemented, and some of the output Tables and Graphics are 
also operational. Preliminary tests are also being conducted to integrate all 
these computer modules. Most of the computer computations are in the check 
out phase, and considerable effort is being made to produce a “user friendly”, 


and easily understood computer package. 
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SOFTWARE COST ESTIMATION STUDY SCHEDULE 


FIGURE 1.-2 


Il. 


Preliminary CER Prototype for AVIONICS Data 


2.0 Introduction 


Figure 2.-1 illustrates, in summary block diagram form the 
basic elements of the CER development process. The emphasis is to 
obtain data which can be easily grouped into homogeneous sub-sets at 
the lowest possible level in the software Work Breakdown Structure 
(WBS) hierarchy. This process inherently yields accurate CER's. 
Thus, the respective classes of software, i.e., manned, unmanned, 
avionics, and ground, across all software types such as Systems, 
Applications, and Support, produce a logical initial breakdown of the 
given data base. These data are further decomposed onto the develop- 
ment life cycle phases, i.e., requirements, design, code, checkout, 
etc. The result is a data base which accurately reflects cost 


accrual by class of cost, time phases, organization, and type of cost. 


The flow for determining the actual CER is illustrated in 
Figure 2.-2. Steps 1 and 2 form the basis of the analysis. The 
utilization of logical sub-sets and grouping of the data into 
separate classes results in removing outliers and enhances the 


Statistical reliability of the observations. 


Steps 3, 4, and 5 are pre-regression type analyses to 
condition and further screen the data for significant groupings, so 
that homogeneity is yet enhanced. Step 3 includes statistical 
correlation, while steps 4 and 5 identify the minimal set of 
variables which are both necessary and sufficient to yield suitable 
cost factors, in terms of “complexity” measures that are correlated 
with cost. Included in these steps are data normalization and data 


conditioning procedures and protocols. 


Step 6 determines the functional form of the regression 
analysis, in terms of the best statistical fit to the observed data. 
Here, the residuals are examined, and an "F" statistic computed. 
Also, additional analyses may be performed to examine the respective 
components of the analysis of variance, so that linear, quadratic, 
and other statistically significant higher order effects may be taken 


into account. 
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Quantify Complexity & 
Combine into 3 

Independent Variables 
for Each Data Point 
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- Assign Complexity 
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Project Complexity 
Mix Complexity 

- Determine Adequate 
Development Time 
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Perform *MRA To 
Determine Best Fit 
Equation for Each 


Output Simple CER 
Equations for Estimating 


Determine Which Technical 
Independent Variable 
Correlates Best with Cost 


Delivered Source Lines of Code 
- Schedule 

- Requirements 

- Functions 

- Complexity 


Determine Which Complexity 
Factors Correlate Best 
with Cost 
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: sales WOE. ed ULL aoa Way eee 
coae Power y = a(x,°1)(x.°2) (x33) 
: nee 7 *Multiple regression ane lyeis 


Figure 2.-2 FLOW FOR DEVELOPING CER'S 


Table 2.-1 summarizes some of the basic raw data collected 
in deriving preliminary CER's for AVIONICS. Basically, the data are 
Organized by type of software, i.e., Systems, Applications, and 
Support, and further delineated into either assembly or HOL (Higher 
Order Language). In addition, these data pertain to the Software 
Engineering functions only, and do not include the Systems 
Engineering or Test organizations and their related activities. 
Also, the respective life cycle phases addressed were requirements, 
design, code, and test. (These data do not include the planning or 
maintenance phases.) 

Figure 2.-3 illustrates the plot of these seven (7) 
AVIONICS data points for a log-log scale. In addition, the circled 
points labeled F-111, and AWACS represent previous programs which 
were similar in nature to the current data obtained. The generic 


form of the fitted equation is a straight line given by: 


log(HOURS) = log(CONSTANT) + (EXPONENT)log(HOL EQ). 


Obviously, the (EXPONENT) coefficient represents the slope of the 
line, which is also the productivity factor. For this sample plot, 
the value obtained is approximately 3.9 Hours/LOC. This now 
represents a sample value for use in the SASET model. Also, the 
AVIONICS functions associated with this data base will be included in 
the SASET model. These data will conform to the indexing system 
developed in the following section. (Section 3.2, Functional Sizing 
of AVIONICS Data). 

Tt is anticipated that additional effort will be devoted to 
refine the AVIONICS data base. For example, the LANTIRN program 
contains pertinent cost, sizing, and schedule data concerning the 


individual CPCI's developed, down to the module level. 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


Table 2.-1L Summary of AVIONICS S/W Programs 


PAE (Precision Attack Enhancement) 

AVIONICS Support S/W 

17,000 HOL Source Lines of Code 

Language - Jovial. New HOL equivalents: 17,000 
33,864 hours for S/W Development 


Laser Spot Tracker (on board F-18) 

AVIONICS Applications S/W 

9,082 Assembly Language Source Lines of Code 
Language - Assembly. New HOL equivalents, 2,331 
16,268 hours for S/W Development 


TAD's (Laser System on Apache Helicopter) 
AVIONICS Applications S/W 

21,000 Assembly Language Source Lines of Code 
Language - Assembly. New HOL equivalents: 6,167 
25,232 hours for S/W Development. 


ASSAULT BREAKER 

AVIONICS Applications S/W 

12,200 Assembly Language Source Lines of Code 
Language - Assembly. New HOL equivalents: 4,067 
15,438 hours for S/W Development. 


Single Seat Aircraft (night attack fighter) 
AVIONICS Applications S/W 

8,000 Assembly Language Source Lines of Code 
Language - Assembly. New HOL equivalents: 2,667 
10,641 hours for S/W Development. 


Operational Flight Program (close air support) 
AVIONICS Applications S/W 

14,100 Assembly Language Source Lines of Code 
Language ~ Assembly. New HOL equivalents: 4,700 
19,721 hours for S/W Development. 


LANTIRN 

AVIONICS Applications S/W 

310,000 Source Lines of Code (Assembly/Fortran) 
265,428 new HOL equivalents. 

614,200 hours for S/W Development. 


aan 


1,000,004 


AWACS @& 


MANHOURS 


1,000 10,000 100,000 1,000,000 


NEW HOL EQUIVALENTS (LINES OF CODE) 


Figure 2.-3 PLOT OF NEW HOL EQUIVALENTS VS. MANHOURS 
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Ill. 


Functional Sizing of AVIONICS Data 


Table 3.~-2 illustrates the overall scheme for catagorizing 
software functional data. This specific classification hierarchy was 
obtained from the most recent (January, 1987) ASPS Cost Reporting 
Document (Section VIII, Software Reporting Requirements). Although 
AVIONICS is delineated as a special category, it should be noted that 
other given platforms, such as space-borne or shipboard, do indeed 
have similar functions described by index elements 2.1 to 2.6. Also, 
the "Off-Line Training” (comprising index elements 15.1 to 15.4) has 
been reconfigured into two (2) Data Reduction items (Category A and 
B) to reflect activities involving moderate and extensive processing 
requirements, in either real-time or off-line modes. This functional 
list is utilized as a template for subsequently structuring the SASET 
model data base. In some instances an addititional level of indexing 
was used to describe lower level functions. For example, when 
representing the functional activities for “Processing Software” 
under "Modeling", the SASET data base hierarchy will index to two 
lower levels, i.e., type of “modeling” and the respective parameters 
associated with the “modeling” functions. Thus, Rapid Prototyping 
(type of modeling) has sub-categories of requirements, design, 


graphics, etc, as indenture levels. 


Some Normalized Functional Sizing Statistics for AVIONICS 
are shown in Table 3.-3. These data were originally obtained from 
ARINC Research Corporation, technical report “Software Sizing and 
Cost Estimation”, (July, 1985) prepared for the Office of the 
Controller (NCDS), Department of the Navy, Washington, D.C. under 
Contract N00600-87-D-4045, Delivery Order No. 0003, CDRL Item No. 
A0002. However, these respective values have been modified using 
both updated data and the algorithms formulated in the SASET model to 
reflect nominal baseline numbers. The resultant processed values are 
used as input to the SASET models. The SASET modifications reflect 
an increase of approximately 73%. This factor takes into account 
both the skewness of the distribution used in the SASET sizing 
algorithms, and the range of three (3) sigma values covered by these 
functions. 
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Displays 


Avionics 
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TABLE 3.-2 


Software Functions 


Function 


Avionics 
Command, Control, & Communications 
Other 


Mission Planning 

Navigation 

Aircraft Steering Flight Control 

Sighting, Designation & Location Determination 
Weapon Delivery 

Electronic Countermeasures 

Other 


Network Monitoring 

Network Control & Switching 
Sensor Control 

Signal Processing 

Message Processing 

Message Distribution 
Message Logging & Retrieval 
Data Reduction 

Other 


Computer Resource Management 

Computer Operator Interface 

Other Terminal Operator Interface 
Special Device Interface 

Other Input or Output 

Error Handling/Reconfiguration/Recovery 
Multicomputer Configuration Control 
Performance Monitoring & Data Collection 
Other 


On-line Data Base Retrieval & Output 
On-line Data Base Initialization & Updating 
Other 


Control of Exercise Sequencing 
Operator Performance Data Collection 
Other 


System Readiness Test 

Computer Diagnostic 

Memory Diagnostic 

Display Diagnostic 
Switch/Indication Panel Diagnostic 
I/O Diagnostic 

Mod Diagnostic 

Other 
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Category 


Operating System 


Equipment 
Maintenance 


Software 


Off-Line Data Base 
Management 


Design 


Test Software 


Ucilities 


TABLE 3.-2 


Software Functions (continued) 


Index 


° 
NOU WHE 


coo © 0% OO © 
e e 


Oo 0 
oe 
ne 


Function 


Computer Resource Management 

Computer Operator Interface 

Terminal Operator Interface 

Input or Output 

Error Handling/Reconf iguration/Recovery 
Performance Monitoring & Data Collection 
Other 


Off-Line Computer Diagnostics 
Other 


Higher-Order Language Compiler 
Assembler 

Debugger 

Loader or Editor 

Other 


Data Base Definition 

Data Base Initialization & Updating 
Data Base Retrieval & Output Formatting 
Data Base Restructuring 

Off-Line Data Base 

Other 


Data Base Design 

Data Base Processor Design 
Performance Simulation 
Data Reduction 

Data Analysis 

Other 


Test Case Generation 
Test Case Data Recording 
Test Data Reduction 
Test Analysis 

Other 


Media Conversions 

Format Translation 
Sort/Merge 

Program Library Maintenance 
Other 
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Category 
Off-Line Training 


Project Management 


Hardware Subsystem 
Simulations 


TABLE 3.-2 


Software Functions (continued) 


Index 


15.1 
15.2 
15.3 
15.4 


16.1 
16.2 
16.3 
16.4 
16.5 
16.6 
16.7 
16.8 


17.1 
17.2 
17.3 
17.4 


Data Reduction, Category A 
Data Reduction, Category B 
Scenario Preparation 

Other 


Project Event Status Account 
Schedule Maintenance/ Projection 
Financial Accounting 

Software Cost Reporting 
Hardware Cost Reporting 
Software Cost Prediction 
Hardware Cost Prediction 

Other 


Interfacing Hardware Simulations 
Environmental Simulators 
Operator Action Simulations 
Other 


espace 


TABLE 3.-3 


NORMALIZED FUNCTIONAL SIZING STATISTICS FOR AVIONICS 


ARINC SASET 

Average Average 
Function Size Size 

Index (LOC)* _ (LOC)* 
1.1 633 1096 
1,2 2888 5000 
1.3 4199 7273 
2.2 1376 2383 
2.4 2106 3648 
2.5 9000 15590 
2.6 7057 12223 
2.7 3567 6178 
3.1 7164 12400 
3.2 4296 7440 
3.3 5661 9800 
3.4 2741 4747 
3.5 8220 14237 
3.6 1211 2100 
3.9 1232 2100 
4.1 4129 7150 
4,2 6212 10740 
4.3 12501 21650 
4.4 2512 4350 
4.5 560 970 
4.8 3434 5950 
5.1 6172 10600 
5.2 1314 2275 
5.3 9021 15625 
7.1 898 1555 
10.3 795 1375 
13.1 3935 6815 
13.4 10963 18988 
17.1 229 400 
17.2 9000 15588 


* LINES OF CODE (HOL equivalent) 
Less Comments 
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Iv. Calibration of AVIONICS Data 


Figures 4.-1 through 4.-12 illustrate typical calibration curves 
obtained using the mix complexity and project complexity parameters 
defined in reference (2) “Cost Drivers Report.” The respective 
curves are based upon AVIONICS data from over 150 real world software 
‘development projects. The equation plotted has the following generic 


form: 
‘ ; Ci C2 
(Productivity) = (Factor) (Conversion) (Mix) (Prog) 


The four (4) plots shown for each type of software (Systems, 
Application, Support) illustrate the sensitivity of the corresponding 
independent variable used. As can be observed from the curves, these 
data are well within the range of the productivity factor derived 
from the CER given in Figure 2.-l1. Furthermore, the overall 
variation of complexity factors defined can be utilized to obtain 
fine gradations of productivity factors within each type of 

software. Thus, SASET can be validated using the table look-ups from 
which the plots were originally derived. 


Appendix I illustrates the tabular data associated with the 
curves illustrated above (Application Software). Only a sample 
segment of the data are illustrated. This includes variations and 
sensitivity analysis when each of the four (4) variables (Factor, 
Conversion, Mix, and Program variables) given by the above equation 
are treated as “independent” variables. Similar tables are 


formulated for Systems and Support software. 
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